Voice-controlled system that checks program guide to determine channel on which program name determined according to voice-to-text transcript is currently playing

ABSTRACT

A voice-controlled system for allowing a guest of a hospitality establishment to play desired media content on an in-room device includes one or more servers coupled to a network and a plurality of in-room devices. A user device captures audio from a microphone and converts the audio into a text transcript utilizing a voice-to-text conversion service. The user device passes the text transcript to the servers where a particular room of the hospitality establishment with which the user device is currently associated is determined. The servers check a program guide for the particular room in order to determine a channel on which a program name determined according to the text transcript is currently playing, and determine one or more target in-room devices of the particular room. The servers send commands causing the target in-room devices to play the channel on which the program name is currently playing.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.17/108,174 filed on Dec. 1, 2020, which is a divisional of U.S. patentapplication Ser. No. 16/699,466 filed on Nov. 29, 2019, which is acontinuation of U.S. patent application Ser. No. 16/390,637 filed onApr. 22, 2019, which is a divisional application of U.S. patentapplication Ser. No. 15/834,961 filed on Dec. 7, 2017, which claims thebenefit of priority of U.S. Provisional Application No. 62/433,693 filedDec. 13, 2016. All of these applications are incorporated herein byreference.

BACKGROUND OF THE INVENTION (1) Field of the Invention

The invention pertains generally to entertainment and other electronicsystems utilized at hospitality establishments such as hotels andresorts. More specifically, the invention relates to a data gate forinterfacing between a plurality of different electronic systems, and asystem for controlling devices within a guest room utilizing a user'svoice.

(2) Description of the Related Art

One problem with hotel technology is the integration of differentelectronic systems. FIG. 1 shows a block diagram of the typicalinterconnection of different hotel systems within a hotel according tothe prior art. As shown, the phone private branch exchange (PBX) system100, Internet system 102, property management system (PMS) 104, point ofsale system 106, in-room video system 108, and room control servicessystem 110 are all directly connected with one another as needed usingdedicated connections. Each of these systems needs to talk to at leastone other system and some, like the PMS 104, need to talk with manyseparate systems. For this reason, each service needs to develop its owndedicated interfaces to communicate properly with each connected system.

The current approach illustrated in FIG. 1 is hard to manage andupgrade. Whenever a hotel brings on a new vendor, the hotel needs tomake sure the new vendor system is compatible with all the other vendorsystems. The installation process is therefore complex, error prone, andleads to much finger pointing about who is responsible for what.

Another problem with hotel technology is the control of in-room andother electronic devices. The first thing many hotel guests do afterthey have connected to a hotel's high speed internet access (HSIA)system is to turn on the in-room television (TV). The TV is usually onand tuned to the guest's channel of choice within five minutes of aguest getting into the room.

However, many guests do not enjoy using the hotel-provided TV infraredremote control. Besides being unfamiliar to the guest, the remotecontrol can be a spawning ground for germs and a possible way to pick upa cold. Getting ill is something most people do not wish to happen whiletravelling. The fact that many unknown people have previously handledthe remote is not appealing to the average guest.

One way to prevent the need for a guest to pick up the remote is toallow room control with voice commands. There are a few initiativesgoing on in the industry today around voice controlling the hotel room.Current trials typically take the form of some sort of device such as apreconfigured iPad™ being provided by the hotel in the guest room. TheiPad is set up in advance by hotel staff specifically for the room inwhich it is placed and is intended to respond to the voice commands ofthe guests in that room.

The preconfigured iPad-in-the-room solution has several issues making ita non-ideal solution. First, the hotel needs to buy all these devicesfor every room in the hotel. These initial cost requirements are asignificant barrier to entry for many hotels. Furthermore, the hotelneeds to set up all the devices in the room and ensure they remainproperly configured, properly cleaned, and properly updated over time.Guests will move these devices around, unplug them, perhaps evenmanipulate them and put unwanted software on them. Worst yet, a guestcould walk out of their room with the iPad in their luggage.Additionally, guests are likely to object to the iPad in the room forprivacy reasons.

In the early nineties, some hotels tried installing a full desktopcomputer in each guest room. One of the features of early setups was asmall web camera intended to allow guests to conduct video conferenceswith colleagues.

The in-room computer and especially the web camera was a huge flop for acouple of reasons. For one, at that time people were starting to carrytheir own laptops with them more and more and these tech savvy guestswanted to use their own device. They had all the files and all thesettings just as they wanted them on their own device and they knew howto use their laptop instead of having to figure out where everything wason a foreign computer. But the biggest issue was the web camera. Peoplewere concerned by the idea that they were being watched by thepreinstalled web cameras. The in-room web camera was great idea withgood intentions that inadvertently caused massive privacy concerns.Shortly after they were installed, they were all pulled out.

However, it seems the industry is now trying the same experiment within-room iPads provided by the hotel in each room. It is likely manyguests are going to have the same reaction that has already beendiscovered by the industry about other in-room technology. For one, manyguests will not want to physically touch the hotel-provided iPad. It isnot theirs. It is potentially dirty. It might break and they will beheld responsible. But more importantly they are going to wonder whatnefarious things it might be used for. An iPad has a microphone thatcould be listening to them. In fact, to enable voice commands, the iPadliterally needs to do just that. Whether it does anything additionalwith the audio is unknown to the guest. It is not the guest's device.Furthermore, a hotel-provided iPad has a video camera built-in. Althoughnot needed for voice commands, a typical guest will not trust that thecamera has been effectively disabled. They will worry why there is aforeign video camera in their hotel room. They may be fearful that anefarious individual has access to the device. Some may demand thedevices be removed. Bottom line, the in-room device is not theirs, somany guests will not trust it.

BRIEF SUMMARY OF THE INVENTION

According to an exemplary embodiment of the invention there is discloseda data gate apparatus for interfacing between a plurality of services.The data gate apparatus includes a storage device, a network interface,and a processor coupled to the storage device and the communicationinterface. By the processor executing software instructions loaded fromthe storage device, the processor is operable to learn a first interfaceformat of a first of the services at least by receiving a first datafunction from the first of the services via the communication interfaceand identifying a field in the first data function, the fieldrepresenting a position in data functions having the first interfaceformat where information of a particular type is passed. The processorassociates a variable with the field, the variable representing theinformation of the particular type, and store the first interface formatin the storage device for future use. The processor further receives asecond data function via the communication interface from the first ofthe services, the second data function having the first interfaceformat. Furthermore, the processor identifies the field in the seconddata function according to the first interface format in the storagedevice, extracts a value from the field in the second data function andstore the value as the variable, generates a message in a secondinterface format different than the first interface format and insertsthe value of the variable in the message, and sends the message in thesecond interface format to a second of the services. In this way, thesecond of the services receives the value of the variable representingthe information of the particular type as passed from the first of theservices without the second of the services needing to understand thefirst interface format utilized by the first of the services.

According to an exemplary embodiment of the invention there is discloseda system for interfacing between a plurality of services.

According to an exemplary embodiment of the invention there is discloseda method of interfacing between a plurality of services. The methodincludes learning a first interface format of a first of the services atleast by receiving a first data function from the first of the servicesvia a communication interface and identifying a field in the first datafunction, the field representing a position in data functions having thefirst interface format where information of a particular type is passed.The method further includes associating a variable with the field, thevariable representing the information of the particular type, andstoring the first interface format in a storage device for future use.The method further includes receiving a second data function via thecommunication interface from the first of the services, the second datafunction having the first interface format, identifying the field in thesecond data function according to the first interface format in thestorage device, extracting a value from the field in the second datafunction and storing the value as the variable, generating a message ina second interface format different than the first interface format andinserting the value of the variable in the message, and sending themessage in the second interface format to a second of the services. Inthis way, the second of the services receives the value of the variablerepresenting the information of the particular type as passed from thefirst of the services without the second of the services needing tounderstand the first interface format utilized by the first of theservices.

According to an exemplary embodiment of the invention there is discloseda non-transitory computer-readable medium for interfacing between aplurality of services. The non-transitory computer-readable mediumincludes computer executable instructions for interfacing between aplurality of services that when executed by a computer cause thecomputer to perform steps at least including learning a first interfaceformat of a first of the services at least by receiving a first datafunction from the first of the services via a communication interfaceand identifying a field in the first data function, the fieldrepresenting a position in data functions having the first interfaceformat where information of a particular type is passed. Thenon-transitory computer readable medium further includes associating avariable with the field, the variable representing the information ofthe particular type, and storing the first interface format in a storagedevice for future use. The non-transitory computer readable mediumfurther includes receiving a second data function via the communicationinterface from the first of the services, the second data functionhaving the first interface format, identifying the field in the seconddata function according to the first interface format in the storagedevice, extracting a value from the field in the second data functionand storing the value as the variable, generating a message in a secondinterface format different than the first interface format and insertingthe value of the variable in the message, and sending the message in thesecond interface format to a second of the services. In this way, thesecond of the services receives the value of the variable representingthe information of the particular type as passed from the first of theservices without the second of the services needing to understand thefirst interface format utilized by the first of the services.

According to an exemplary embodiment of the invention there is discloseda system for controlling devices in a guest room of a hospitalityestablishment. The system includes a user device operated by a guest ofthe hospitality establishment, the user device having a microphone and anetwork interface coupled to a computer network, a voice-to-text servercoupled to the network, and a room control server coupled to thenetwork. The user device is operable to record an audio file from themicrophone and send the audio file from the user device to thevoice-to-text server via the computer network. The voice-to-text serveris operable to convert the audio received from the user device into atext transcript and send the text transcript back to the user device.The user device is further operable to pass the text transcript to theroom control server. The room control server is operable to determine aparticular room of the hospitality establishment with which the userdevice is currently associated. The room control server is furtheroperable to decode the text transcript into a room control command, andthe room control server is further operable to determine one or moretarget in-room controllable devices of the particular room to which theroom control command pertains. The room control server is furtheroperable to send one or more network messages to the one or more targetin-room controllable device thereby causing the one or more targetin-room controllable devices to carry out the room control command.

According to an exemplary embodiment of the invention there is discloseda method for controlling devices in a guest room of a hospitalityestablishment.

According to an exemplary embodiment of the invention there is discloseda computer server for controlling devices in a guest room of ahospitality establishment.

According to an exemplary embodiment of the invention there is disclosedan apparatus for controlling devices in a guest room of a hospitalityestablishment.

According to yet another exemplary embodiment of the invention there isdisclosed a data gate apparatus for integrating functionalities of aninterface format into a plurality of services. The data gate apparatusincludes a storage device, a communication interface, and a processorcoupled to the storage device and the communication interface. By theprocessor executing software instructions loaded from the storagedevice, the processor is operable to detect a first interface format ofa first of the services via the communication interface. In response todetermining that the first interface format is different than theinterface formats stored in the storage device, the processor learns thefirst interface format at least by receiving a first data function fromthe first of the services and identifying a field in the first datafunction, the field representing a position in data functions having thefirst interface format where an information of a particular type ispassed. Thereafter, the processor associates a variable with the field,the variable representing the information of the particular type, andstores the first interface format in the storage device for future use.The processor verifies that the first interface format stored in thestorage device is functional at least by: installing the first interfaceformat on the data gate, generating a message in the first interfaceformat, and sending the message in the first interface format to thefirst of the services wherein the message at least causes the first ofthe services to send a response message to the data gate. The processorreceives the response message from the first of the services via thecommunication interface, parses the response message to thereby confirmthat the first interface format stored in the storage device isfunctional and integrable into the plurality of services.

According to yet another exemplary embodiment of the invention there isdisclosed a method of integrating functionalities of an interface formatinto a plurality of services. The method includes detecting a firstinterface format of a first of the services and determining that thefirst interface format is different than the interface formats stored ina storage device. The method further includes learning the firstinterface format at least by receiving a first data function from thefirst of the services and identifying a field in the first datafunction, the field representing a position in data functions having thefirst interface format where an information of a particular type ispassed, associating a variable with the field, the variable representingthe information of the particular type, and storing the first interfacein the storage device for future use. The method further includesverifying that the first interface format stored in the storage deviceis functional at least by: installing the first interface format on adata gate, generating a message in the first interface format, andsending the message in the first interface format to the first of theservices wherein the message at least causes the first of the servicesto send a response message. The method further includes receiving theresponse message from the first of the services and parsing the responsemessage to thereby confirm that the first interface format stored in thestorage device is functional and integrable into the plurality ofservices.

According to yet another exemplary embodiment of the invention there isdisclosed a system for voice control of devices at a hospitalityestablishment. The system includes one or more computer servers and aplurality of controllable devices coupled to the one or more computerservers. The one or more computer servers are configured to send a firstmessage to a user device operated by a guest of the hospitalityestablishment in response to a first trigger. The first message causes apredetermined software application on the user device to temporarilyregister itself with a pre-existing voice assistant software running onthe user device thereby causing the pre-existing voice assistantsoftware to pass one or more voice-to-text transcripts to thepredetermined software application. The pre-existing voice assistantsoftware only passes the voice-to-text transcripts to the predeterminedsoftware application while the predetermined software application isregistered with the pre-existing voice assistant. The one or morecomputer servers are further configured to receive a command from thepredetermined software application running on the user device, thecommand corresponding to a text transcript passed to the predeterminedsoftware application by the pre-existing voice assistant softwarerunning on the user device. The one or more computer servers are furtherconfigured to determine a particular room of the hospitalityestablishment with which the user device is currently associated. Theone or more computer servers are further configured to determine one ormore target in-room controllable devices of the particular room to whichthe command pertains. The one or more computer servers are furtherconfigured to send one or more network messages to the one or moretarget in-room controllable devices thereby causing the one or moretarget in-room controllable devices to carry out the command. The one ormore computer servers are further configured to send a second message tothe user device in response to a second trigger, the second messagecausing the predetermined software application on the user device toderegister itself with the pre-existing voice assistant software runningon the user device.

According to yet another exemplary embodiment of the invention there isdisclosed a control server for supporting voice control of devices at ahospitality establishment. The control server includes a networkinterface for coupling to a computer network of the hospitalityestablishment, a storage device, and one or more processors coupled tothe network interface and the storage device. By the one or moreprocessors executing software instructions loaded from the storagedevice, the one or more processors are configured to send a firstmessage to a user device operated by a guest of the hospitalityestablishment in response to a first trigger. The first message causinga predetermined software application on the user device to temporarilyregister itself with a pre-existing voice assistant software running onthe user device thereby causing the pre-existing voice assistantsoftware to pass one or more voice-to-text transcripts to thepredetermined software application. The pre-existing voice assistantsoftware only passes the voice-to-text transcripts to the predeterminedsoftware application while the predetermined software application isregistered with the pre-existing voice assistant. The one or moreprocessors are further configured to receive a command from thepredetermined software application running on the user device, thecommand corresponding to a text transcript passed to the predeterminedsoftware application by the pre-existing voice assistant softwarerunning on the user device. The one or more processors are furtherconfigured to determine a particular room of the hospitalityestablishment with which the user device is currently associated. Theone or more processors are further configured to determine one or moretarget in-room controllable devices of the particular room to which thecommand pertains. The one or more processors are further configured tosend one or more network messages to the one or more target in-roomcontrollable devices thereby causing the one or more target in-roomcontrollable devices to carry out the command. The one or moreprocessors are further configured to send a second message to the userdevice in response to a second trigger, the second message causing thepredetermined software application on the user device to deregisteritself with the pre-existing voice assistant software running on theuser device.

According to yet another exemplary embodiment of the invention there isdisclosed a method of supporting voice control of devices at ahospitality establishment. The method includes sending, by one or morecomputer servers, a first message to a user device operated by a guestof the hospitality establishment in response to a first trigger. Thefirst message causing a predetermined software application on the userdevice to temporarily register itself with a pre-existing voiceassistant software running on the user device thereby causing thepre-existing voice assistant software to pass one or more voice-to-texttranscripts to the predetermined software application. The pre-existingvoice assistant software only passes the voice-to-text transcripts tothe predetermined software application while the predetermined softwareapplication is registered with the pre-existing voice assistant. Themethod further includes receiving, by the one or more computer servers,a command from the predetermined software application running on theuser device, the command corresponding to a text transcript passed tothe predetermined software application by the pre-existing voiceassistant software running on the user device. The method furtherincludes determining, by the one or more computer servers, a particularroom of the hospitality establishment with which the user device iscurrently associated. The method further includes determining, by theone or more computer servers, one or more target in-room controllabledevices of the particular room to which the command pertains. The methodfurther includes sending, by the one or more computer servers, one ormore network messages to the one or more target in-room controllabledevices thereby causing the one or more target in-room controllabledevices to carry out the command. The method further includes sending,by the one or more computer servers, a second message to the user devicein response to a second trigger, the second message causing thepredetermined software application on the user device to deregisteritself with the pre-existing voice assistant software running on theuser device.

According to yet another exemplary embodiment of the invention there isdisclosed a voice-controlled system for allowing a guest of ahospitality establishment to play desired media content on an in-roomdevice. The system includes a user device operated by a guest of thehospitality establishment, the user device having a microphone and anetwork interface. The system further includes one or more serverscoupled to a computer network and a plurality of in-room devices coupledto the one or more servers. The user device is operable to capture audiofrom the microphone and convert the audio into a text transcriptutilizing a voice-to-text conversion service. The user device is furtheroperable to pass the text transcript to the one or more servers via thecomputer network. The one or more servers are operable to determine aparticular room of the hospitality establishment with which the userdevice is currently associated. The one or more servers are furtheroperable to check a program guide for the particular room in order todetermine a channel on which a program name determined according to thetext transcript is currently playing. The one or more servers arefurther operable determine one or more target in-room devices of theparticular room and send one or more commands to the one or more targetin-room devices of the particular room thereby causing the one or moretarget in-room devices to play the channel on which the program name iscurrently playing.

According to yet another exemplary embodiment of the invention there isdisclosed a control server for allowing a guest of a hospitalityestablishment to play desired media content on an in-room device. Thecontrol server includes a network interface for coupling to a computernetwork of the hospitality establishment, a storage device, and one ormore processors coupled to the network interface and the storage device.By the one or more processors executing software instructions loadedfrom the storage device, the one or more processors are configured toreceive a text transcript from a user device via the computer network,the user device being operated by the guest of the hospitalityestablishment. The one or more processors are further configured todetermine a particular room of the hospitality establishment with whichthe user device is currently associated and check a program guide forthe particular room in order to determine a channel on which a programname determined according to the text transcript is currently playing.The one or more processors are further configured to determine one ormore target in-room devices of the particular room and send one or morecommands to the one or more target in-room devices of the particularroom thereby causing the one or more target in-room devices to play thechannel on which the program name is currently playing.

According to yet another exemplary embodiment of the invention there isdisclosed a method of allowing a guest of a hospitality establishment toplay desired media content on an in-room device. The method includesreceiving, by one or more computer servers, a text transcript from auser device via the computer network, the user device being operated bythe guest of the hospitality establishment. The method further includesdetermining, by the one or more computer servers, a particular room ofthe hospitality establishment with which the user device is currentlyassociated. The method further includes checking, by the one or morecomputer servers, a program guide for the particular room in order todetermine a channel on which a program name determined according to thetext transcript is currently playing. The method further includesdetermining, by the one or more computer servers, one or more targetin-room devices of the particular room. The method further includessending one or more commands from the one or more computer servers tothe one or more target in-room devices of the particular room therebycausing the one or more target in-room devices to play the channel onwhich the program name is currently playing.

These and other advantages and embodiments of the present invention willno doubt become apparent to those of ordinary skill in the art afterreading the following detailed description of preferred embodimentsillustrated in the various figures and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be described in greater detail with reference to theaccompanying drawings which represent preferred embodiments thereof:

FIG. 1 shows a block diagram of the typical interconnection of differenthotel systems within a hotel according to the prior art.

FIG. 2 shows a block diagram the interconnection of different systemsinterconnected by a data gate according to an exemplary embodiment ofthe present invention.

FIG. 3 shows a flowchart of a method of setting up the data gate of FIG.2 for enabling communication with a different interface type accordingto an exemplary embodiment.

FIG. 4 shows an example of the visual user interface that may bedisplayed by the data gate at the “Learn interface” step of FIG. 3.

FIG. 5 illustrates an example of a PMS function called “Guest folio”,which is the data function response to a “Get folio” data functionmessage sent to the PMS of FIG. 2.

FIG. 6 illustrates a block diagram of a data gate of FIG. 2 located at ahotel property communicating with a cloud PBX and cloud PMS ensuringconnectivity between the two.

FIG. 7 shows a trip flow where all data needed by the guest during theirtrip is integrated with a single app funning on the user's mobile phonevia the data gate of FIG. 6.

FIG. 8 shows a block diagram of a system for allowing a guest of ahospitality establishment to utilize their voice to control one aspectsof a guest room according to an exemplary embodiment.

FIG. 9 shows a flowchart of a method of controlling a guest room usingvoice commands according to an exemplary embodiment.

FIG. 10 illustrates a computer server merging the functionality of thedata gate of FIG. 2 with room control and high speed internet access(HSIA) controllers of FIG. 8 according to an exemplary embodiment.

DETAILED DESCRIPTION

FIG. 2 shows a block diagram the interconnection of different systemsinterconnected to a data gate 200 according to an exemplary embodimentof the present invention. In the following description, it will beassumed that the interconnected system service one or more hotels, butit is to be understood that the data gate 200 may also be utilized inconjunction with any system and may service any type of establishmentincluding hospitality establishments other than hotels. In contrast tothe interconnection scheme shown in FIG. 1, in FIG. 2 each of the phoneprivate branch exchange (PBX) system 202, Internet system 204, propertymanagement system (PMS) 206, point of sale system 208, in-room videosystem 210, and room control services system 212 are all coupled to acentral data gate 200. The data gate 200 is a unified communicationgateway through which all services and systems at the hotel talk to oneanother.

The data gate 200 acts as a traffic cop to make sure information gets towhere it needs to go. This way, if a hotel needs to replace one of theseservices with a different one, the hotel does not need to wait for allthe integration work to be re-done to ensure compatibility of the newsystem with those of the other vendors.

FIG. 3 shows a flowchart of a method of setting up the data gate 200 forenabling communication with a different interface type according to anexemplary embodiment. The steps of FIG. 3 may be performed by one ormore processors of the data gate 200 executing software instructions inconjunction with optional input from an administrator or technicalsupport staff via a user interface (UI). The steps of the flowchart arenot restricted to the exact order shown, and, in other configurations,shown steps may be omitted or other intermediate steps added.

At step 300, the process begins upon starting the setup process of thedata gate 200. For instance, this may represent the initial installationof the data gate 200 at a new hotel, or may represent a change of one ofthe existing vendor systems 202, 204, 206, 208, 210, 212 at a hotel. TheUI may have a menu item to initiate an interface setup mode.

At step 302, the data gate 200 determines whether a new interfaceconnection type is required to be learned. Each type of vendor systemmay have different interface requirements. The requirements may includedifferent message protocols and/or connection types. In someembodiments, step 302 is implemented as an on-screen menu for anadministrator to select whether they want to learn a new interface or toselect an existing one from a library of available interfaceconfigurations. In some embodiments, step 302 is implemented as anautomatic detection performed by the data gate 200 itself detecting aphysical cable being plugged in such as an RS-232 or Ethernet cable,and/or detecting a type of the connected device and/or a requiredprotocol version. The data gate 200 may automatically detect whether ornot the connected system is of a known type of an unknown type. When anew interface type is required to be learned, control proceeds to step304; otherwise, when the interface is already recognized, controlproceeds to step 310.

At step 304, the data gate 200 learns the new interface type. In someembodiments, the learning process is facilitated by a graphical userinterface (UI) that displays captured function data from the newlyconnected system and allows an administrator to highlight fields withinthat function data. The highlighted fields are then mapped by theadministrator to specific variables recognized by the data gate 200. Insome embodiments, the data gate is able to automatically recognize andreproduce the formatting around the variables in order to create newfunction data that is compatible (i.e., compliant) with the newinterface type. Learning can also initially be started by a userentering in and setting up the interface based on a spec doc using theUI. Then the testing and changes done through the learning processesdescribed herein can be made by the user using the UI. The spec doc maybe manually entered or downloaded from an interface library. Althoughsome embodiments require an administrator or other technical supportstaff to work with the graphical user interface and manually mapvariables to fields in the function data, there is beneficially nolow-level programming involved in many embodiments so the work requiredby the support staff is greatly simplified. The visual user interfaceallows the data gate to be configured in a faster manner when a newinterface type is required because a greater number of human users willhave the skills necessary to operate a visual user interface versuscoding a low-level interface using a standard text-based programminglanguage.

In some embodiments, the data gate 200 learns the new user interface atstep 304 utilizing machine learning in a fully automated manner thatdoes not involve human user interaction. For instance, a hotel may havean existing interconnection system such as shown in FIG. 1 alreadyworking. The hotel may wish to switch to utilizing a data gate 200 asdisclosed herein for benefits such as allowing future upgrades to bedone in a more convenient manner. In order to convert a system such asillustrated in FIG. 1 to that shown in FIG. 2, the data gate 200 mayfirst be connected to two systems that are already communicatingproperly with one another. The data gate 200 then acts as a transparentproxy between the two devices such that each thinks it is talking withthe other, even though all traffic is in fact being passed through thedata gate 200 for analysis. As the messages flow between the twoconnected devices, the data gate 200 identifies which parts of capturedfunction data are changing in the messages of a same type and determinesthese changing portions of the data to represent fields in thatfunction's data. For instance, a plurality of room billing messages willhave parts of the data representing the room number to bill as well asthe amount to bill changing between different messages. These changingportions of that particular type of function data are thereby identifiedas fields.

The data gate 200 may then utilize heuristic algorithms to detect whichfields should be mapped to which known variables. Each variablerepresents a known type of information. For instance, the data gate 200may recognize that a certain field always contains a number that matchesone of the known room numbers at the hotel. This likely means the fieldshould be mapped to a “Room number” variable. Likewise, a field thatalways contains a number in of the format $XX.XX may be mapped to a“dollar amount” variable. Again, the data gate 200 can also determinethe other formatting requirements and build the interface code as datatraffic is passed between the two systems. At a certain point, allchanging fields in the data will be mapped to variables and all otherformatting requirements will be known and reproducible by the data gate200. The new interface type has been learned. The data gate 200 maythereafter create and send new messages to the two devices using theautomatically learned interface type.

Any combination of machine learning and/or human assistance may beutilized at step 304 to allow the data gate 200 to learn a new interfacetype in the fastest and easiest manner possible. In some cases, theremay not be working connections available for the data gate 200 tomonitor between two systems so a human may choose to use the visualinterface to manually map variables to fields. Likewise, in other cases,the data gate 200 may automatically determine which parts of thefunction data are changing and therefore represent fields, but the humanuser many still manually map the detected fields to specific variablesfor better accuracy. For example, the human user may be able to betterrecognize that a certain field is holding a room number while anotherfield is holding a dollar amount. A human user mapping the knownvariables to the specific fields may be faster or more reliable than thedata gate 200 machine learning this mapping in some situations. Anycombination and permutation of manual and automatic learning may beemployed at step 304 in different embodiments.

At step 306, the data gate 200 tests the newly learned interface. Insome embodiments, the testing process involves human interaction toverify things are working properly. For instance, if the new interfaceis the in-room movie system 210, the data gate 200 may send a number ofchannel change messages, a number of TV on/off messages, etc. The humanuser then verifies that the appropriate channels are displayed and/orappropriate in-room TVs are turned on/off.

In some embodiments, the verification process at step 306 may beautomatic where the data gate 200 receives acknowledgements back fromone or more other devices to confirm that new functionality over theinterface is working. For instance, the data gate 200 may generate andsend an incoming phone call message to the PBX system 202, which ifreceived by the PBX system 200 and properly formatted according to therequired interface type of the PBX system 200 will cause the PBX system202 to generate and send a new message to the TV/Video system 210 todisplay an onscreen phone call alert and mute the volume. This newmessage from the PBX system 202 will be received by the data gate 200(since the data gate 200 is intermediate the PBX system 202 and theTV/Video system 210) and can therefore be utilized to confirm that theoriginal incoming phone call message to the PBX system 202 wassuccessful.

At step 307, the data gate 200 determines whether or not the newinterface type is working properly based on the testing performed atstep 306. For instance, when all the tests are deemed successful, eitherby a manual confirmation process or by the data gate 200 automaticallyconfirming the test result, the data gate 200 marks the new interfaceconfiguration type as finished and proceeds to step 308. Alternatively,if the testing performed at step 306 was not successful, control returnsto step 304 to continue learning the new interface and updating theconfiguration.

At step 308, the data gate 200 adds the newly configured interface to alibrary of interface configurations. The library may be stored in astorage device such as a hard drive or FLASH memory coupled local to theprocessors of the data gate, or may be stored in a cloud based storagedevice such as an interface library server provided by the vendor of thedata gate. As new interface types are learned by the data gate overtime, the library will grow. Especially when the library is stored inthe cloud and accessible by data gates handling interconnections betweendifferent hotels, the frequency at which new interfaces will beencountered will decrease as the library expands over time. Basically,the library of known working interfaces will increase as the data gates200 learn new interfaces configuration across the plurality of hotelsand populate the library. Once an interface type is known and stored inthe library, it can be retrieved and installed by any data gate 200 thatneeds to interconnect with an external system using that interface type.

At step 310, the data gate 200 downloads and installs a known interfacetype from the library. In some embodiments, the administrators or othersupport staff user can filter the existing interface types according togenres such as Video, PMS, PBX, etc. Thereafter, the various knowninterface types may be listed for the selected genre and perhapslabelled utilizing other specified attributes such as the manufacturename, brand, and/or model number of the particular equipment.

At step 312, the data gate 200 leaves setup mode and enters operationalmode for the new interface, either a newly learned interface at step 304or a newly chosen interface from the library at step 310. For this pointon, any of the systems 202, 204, 206, 208, 210, 212 coupled to the datagate can send and receive messages to/from the new interface.

At step 314, the data gate 200 facilitates communication between thevarious systems 202, 204, 206, 208, 210, 212. For example, whilefacilitating communications, the effective operation of the data gate200 in FIG. 2 will be to provide the various connections between thesystems 202, 204, 206, 208, 210, 212 as illustrated in FIG. 1. However,unlike the connection structure of FIG. 1 that require directconnections between the various systems 202, 204, 206, 208, 210, 212, inFIG. 2, the structure simply involves each of the various systems 202,204, 206, 208, 210, 212 being connected to the data gate 200 rather thanto each other.

In some embodiments, conversion between different interface messageformats/types and other implementation details of the data gate 200 aresimilar or the same as described in U.S. Pat. No. 9,185,178 issued Nov.10, 2015 and entitled “INTERFACE GATEWAY AND METHOD OF INTERFACING APROPERTY MANAGEMENT SYSTEM WITH A GUEST SERVICE DEVICE”, U.S. Pat. No.9,456,047 issued Sep. 27, 2016 entitled “INTERFACE GATEWAY AND METHOD OFINTERFACING A PROPERTY MANAGEMENT SYSTEM WITH A GUEST SERVICE DEVICE”,and U.S. patent application Ser. No. 15/254,036 filed Sep. 1, 2016 andentitled “CENTRAL INTERFACE GATEWAY AND METHOD OF INTERFACING A PROPERTYMANAGEMENT SYSTEM WITH A GUEST SERVICE DEVICE VIA THE INTERNET”, whichare each incorporated herein by reference. As the actual conversionbetween known interface types of different types is already well knownin the art, further description of the actual conversion process at step314 is omitted herein for brevity.

At step 316, the data gate 200 determines whether a change to theinterface setup is required. In some embodiments, a hotel or other staffmember may access the visual interface of the data gate 200 to specifythat they are adding a new system or changing an existing system coupledto the data gate 200. Adding a new system or changing an existing systemto a different vendor may require the data gate 200 to be updated to usea new interface type compatible with the new/changed system. Likewise,rather than a manual process, the data gate 200 may itself determinewhen a change is required by automatically detecting the connection of anew system, removal of an old one, or by detecting errors orunrecognized network traffic or messages from one of the systems. Upon achange being required, control returns to step 300 to restart the setupprocess.

FIG. 4 shows an example of the visual user interface 400 that may bedisplayed by the data gate 200 at step 304 of FIG. 3. In this example,the hotel is replacing the room controls service 212. After the old roomcontrols service 212 is replaced with the new one, the connection fromthe new room services system 212 to the rest of the services is broken.This is a key piece of why it is so costly and frustrating to completean integration. Every system speaks a different language. One of thefeatures of the data gate 200 in some embodiments is to simplify theintegration effort and most importantly remove or even eliminate theneed for human users to perform any software development coding as muchas possible. In some embodiments, a simple to use visual user interface400 is provided where a user can analyze the communication pathwaybetween a new system coupled to the data gate 200 and then simply dragand drop fields and variables to create a new interface typeconfiguration for the new system. The interface learning and setup maybe done local at the hotel or the visual user interface 400 may beaccessed remotely over a computer network in different embodiments.

The user interface 400 includes a number of data functions 402 on theleft hand side. The data functions 402 represent messages of particulartypes captured by the data gateway on the new interface. Taking the roomcontrol service 212 as an example, different functions may includemessages sent and/or received in order to: set temperature, open blinds,close blinds, turn on fan, turn off fan, turn on/off desk lamp 1, turnon/off desk lamp 2, turn on/off overhead lights, etc. Other types ofmessages may be represented as different data functions, for instance,for a PMS system data functions may include: post a charge, guestcheck-in, guest check-out, get guest details, etc. Each of these datafunctions 402 may have any number of fields 404 within them such as afunction code, a room number, a target device identifier etc. A setuptechnician may put the data gate 200 into learning mode (step 304) andthen utilize a handheld or other configuration apparatus to send aplurality of proper data functions 402 (i.e., messages, commands, etc.)via the data gate 200 to the new room control system 212. Theconfiguration device may be an iPad or any other portable electronicdevice coupled to the data gate 200 to generate or query the newlyconnected system.

In some embodiments, a handheld configuration apparatus such as thatdisclosed in U.S. Pat. No. 8,250,601 issued Aug. 21, 2012 entitled“CONFIGURATION APPARATUS AND METHOD OF CONFIGURING ONE OR MORE DEVICESHAVING HIDDEN CONFIGURATION SETTINGS”, U.S. Pat. No. 9,106,796 issuedAug. 11, 2015 entitled “CONFIGURATION APPARATUS AND METHOD OFCONFIGURING ONE OR MORE DEVICES HAVING HIDDEN CONFIGURATION SETTINGS”,and US Patent Application Publication No. 20150350017 published Dec. 3,2015 entitled, “AUTOMATED ENTRY OF HIDDEN SERVICE-CONFIGURATION MENU FORTARGET CONFIGURABLE DEVICE SELECTED FROM PLURALITY OF CONFIGURABLEDEVICES IN ROOMS OF HOSPITALITY ESTABLISHMENT” may be utilized. Each ofthese patents and application are incorporated herein by reference.

Any number of specialized scripts may be run on the configuration deviceto send enough data functions 402 to/from the new room control system212 (or other new vendor system) such that the data gate 200 can observeenough data to display the data functions 402 and identified fields 404on the user interface 400.

The data gate 200 may also have the configuration and message generationfunctionality built in such that no separate configuration device isrequired.

The visual user interface 400 may be display on the configuration deviceor any other display device coupled to the data gate 200. By using touchtechnology devices such as an iPad, an interface between services couldbe analyzed by data gate 200 and then presented in a graphical view 400for set up. The user simply drags the different data variables 406understood by the data gate 200 into the available fields 404 of thedifferent functional boxes 402 to define the interface specification. Ofcourse, touch screens are not a requirement and any suitable type ofuser interface may be utilized such as dragging and dropping with acomputer mouse, for example. After mapping variables 406 to fields 404,the data gate 200 then does all the heavy lifting in the background toencapsulate the data with the extra interface encoding needed. Extrainterface encoding may include the fixed formatting requirements of aparticular data function 402 such as where to place commas betweenfields in an array or whether to use square brackets or parentheses,etc. For example, the data gate 200 may recognize common fixedformatting types such as JSON v. XML and populate the data functionswith the required fixed formatting according to the automaticallyrecognized types. A manual fixed formatting type dialog box or selectionmay also be made by the user to speed this process.

Once that is all done, at step 312 the link is re-established between,in this instance, the new room control services 212 and the data gate200, and the rest of the services 202, 204, 206, 208, 210 will againhave the functionality of the room services 212 available for them tocommunicate with.

For instance, the video system 210 is again able to open and close theblinds based on the guest's use of the remote control and the PMS system206 is able to set an economical temperature for the room when it isvacated. This is particularly beneficial because no changes wererequired to be made to the video system 210 or the PMS system 206 inthis embodiment. Instead, the data gate 200 simply learned and activatedthe interface type of the new room control service system 212.

What's more, by having a data gate 200 for all interface traffic to passthrough, the hotel and plurality of vendors have ready access to thedata for auditing purposes. Data audits can put a stop to the fingerpointing between vendors. No more of vendors stating, “our system sentthe data, it must be the other guy.” Data gate 200 storing a log ofsent/received messages in a storage device can prove who (i.e., whatsystem) sent what data and when. Troubleshooting times may bedrastically reduced and a plan for resolution can be presented muchsooner now that the politics have been taken out of the situation.

FIG. 5 illustrates an example of a PMS function called “Guest folio”,which is the data function response to a “Get folio” data functionmessage sent to the PMS 206. During the learning mode at step 304, thevisual user interface 400 will highlight the various fields 404 withinthe function data 402. Of course, a user may indicate these fields 404by highlighting them during inspection of capture data functions 402.However, these fields 404 may instead be automatically detected by thedata gate 200 in some embodiments by the data gate 200 noticing that thecurly and square brackets, quotations, and commas stay the same for each“Guest folio” message, but the highlighted data changes and thereforeshould represent fields 404.

Once the position of the fields 404 in the data function 402 areidentified (either manually or automatically), either the user or thedata gate 200 itself may then drag and drop PMS-related variable 406names such as “Bill name”, “Guest name”, “Amount” onto the matchingfields 404. Once a particular variable 406 is dropped on a particularfield 404, the two are mapped together and the data gate 200 will beable to understand incoming messages with that field or outgoingmessages with that field 404 depending on whether the data functionmessage is incoming or outgoing. Again, mapping variables 406 to fields404 may be a manual operation or an automatic operation. Both modes maybe supported by a single data gate 200 and whether or not to use manualor automatic mapping may be a user configurable option or setting.

The visual user interface 400 may also allow the user to indicate otherstructures in the data functions 402 (and/or the data gate 200 itselfmay automatically perform this as part of the machine learning). Forexample, as shown in FIG. 5, the data function 402 includes a pluralityof two bills records 500. Each of these records 500 includes the samefields 404. By identifying arrays such as the bill records 500, the datagate 200 can be easily configured to recognize and create multiple billrecords in a single message. For instance, the user may highlight thefirst bill record 500 and then right click or other access an attributessection. Within the attributes section, the user is able to specifywhether that field can repeat and if yes how many times (if there is alimit). In this case, each bill record 500 is an array that contains aplurality of fields 404.

The system architecture of FIG. 2 is not intended to limit whetherparticular devices are local at the hotel or provisioned in the cloud.For instance, in different embodiments, any of the various components ofFIG. 4 may be located on premise at the hotel or may be cloud-based andaccessed over the Internet. For instance, the data gate 200 can managecritical business data between systems on property. Likewise, asservices move up to the cloud such as PBXs and even property managementsystems, the data gate 200 can also be connected with and manageintercommunications between these cloud-based services. Likewise, thedata gate 200 may itself be moved into the cloud and may interconnectsystems that are either cloud-based and/or on premise at specifichotels. Any combination of cloud/local positioning may be used for eachof the data gate 200 and the various services connected to one anothervia the data gate 200.

FIG. 6 illustrates a block diagram of a data gate 200 located at a hotelproperty communicating with a cloud PBX 202 and cloud PMS 206 ensuringconnectivity between the two. Data flow between cloud and on propertysystems happens within data gate 200. All systems are able to talk toeach other regardless of their location as if they were directlyconnected to each other. For example, the video system 210 is still ableto post movie charges to the PMS 206. As far as it knows, the PMS 206 isstill on property.

As illustrated in FIG. 6, the data gate 200 may also be connected to acentral authentication system 600 and enable the ability to authenticateguests automatically as they go from property to property based on theirloyalty status or perhaps by agreements with third parties such as telcopartners 610 etc. for revenue sharing.

After a central authentication system 600 is connected to the data gate200, additional functionality is enabled. For example, now the data gate200 can pass data from central authentication 600 to the other servicesa property has in place. One obvious path is to the HSIA system 204, butother systems such as the video and room control systems 210, 212 canalso beneficially make use of data stored at the central authenticationsystem 600. For instance, with this connection in place, these systems210, 212 may query any hotel databases stored at central authenticationfor guest preferences such as a particular guest's language or favouriteTV channels allowing the video system 210 to change the language of theuser interface automatically or to reorder its program guide. Likewise,the room control system 212 can automatically set a preferred roomtemperature for when the guest arrives.

In some embodiments, central authentication handles all the rules forauthentication while the data gate 200 manages the actual flow of data.That way, if a hotel needs to add on another source or service there islittle need for any additional development. Adding in another source ofdata is as easy as it was to add in a service at the property level. Insome embodiments, all connections flow straight through data gate 200,which unburdens various devices like the central authentication 600 fromhaving to handle other queries unrelated to authenticating the user.With the data gate 200 acting as the universal interface gateway, theflow of data is much more efficient and easier to maintain. In this way,hotel-specific guest databases 602 may be stored in the cloud on serversindependent from the central authentication system 600.

One of the top concerns of hotel management is ownership of the guestand guest loyalty. It is a struggle for hotels to capture the guest atthe beginning of their trip planning. Online travel agent (OTA) sitessuch as Expedia, Kayak, Booking and Hotels.com are cannibalizing thehotel's connection with their guests and more importantly, their loyaltymembers. Less and less people are going to hotel web sites to book astay. Instead they go to the OTA aggregators to do this.

However, these OTAs suffer from the same issues as hotel sites. The OTAslose the guest after the booking. For that there are a couple servicesof referred to herein generally as travel or personal assistant sitessuch as WorldMate and Triplt. These are sites that take the guest fromtheir home to a hotel. Users can find it invaluable to keep all travelinformation in one place. When it is time to travel, the user can simplyopen the app and see what time their flight leaves, what airline it is,what hotel their staying at and have all the confirmation numbers in oneplace should they need them during check in.

Bigger players such as Facebook, Linked In, Google, and Apple are justnow recognizing the value of these travel assistant type services. Theselarger players have the resources and products to take this service tothe next level. For instance, Google owns a vast amount of informationand from it they have had services such as Google Flights for some time.It's very easy to look up flights in an easy to use, aggregated view.Now they have recently launched Google Trips this past September. GoogleTrips is very similar to Worldmate or Triplt in that it has all usertravel information in one location. It also includes useful informationabout where the user is traveling to by leveraging the vast amount ofinformation they have stored in their databases from their searchengine. Furthermore, unlike Worldmate or Triplt, a user does not need tosend the information to Google trips. Instead, as long as the user has aGmail account, Google Trips automatically gathers the travel informationdirectly from reservation confirmation messages received in the Gmailaccount and automatically builds up the itinerary for the user.

In this manner, Google now has the ability to interact with a hotelguest even before the guest leaves their own home. Google has all theguest's information and can lead them through all the way to the hotel.Because they have ownership of the operating system on the mobile devicethey could also tightly integrate this functionality right into the OSitself. So the location of the guest could be used to automatically showthe guest's boarding pass on the phone's lock screen if at the airportor show the hotel confirmation number on the phone's lock screen if atthe hotel. Similar to what Apple does today with their wallet. Allwithout requiring the user to dig into their phone to find the right appor email or worse yet, a stack of papers, to find what they need.

Beneficially, these services are integrated with data gate 200 toprovide even better functionality and user experience according to someembodiments. Data gate 200 allows a hotel to continue the personalizedexperience for the guest all the way from their home, to the airport, tothe property, and inside the property for their entire stay, and thenall the way back to their home again.

For instance, by connecting data gate 200 to the airline flight dataservers 604, the system of FIG. 6 allows the hotels to connect up flightinformation with specific guests and get up to date information aboutany delays on arrivals. This way the hotel can know if a guest's flighthas been delayed or cancelled. This gives the hotel better knowledge onwhether to give up the guest's room for the night or whether the roomshould be held.

Data gate 200 can also be connected up with popular ride sharing andother transportation systems 606 such as taxis, ground transport, etc.From the flight information 604, the hotel knew when the guest was inthe city, but with the connection to the ground transport systems 606such as Uber etc., the hotel now can get to the minute updates on whenthat guest will arrive at the hotel.

Connecting the data gate 200 to a plurality of systems as shown in FIG.6 is useful for a number of reasons. To illustrate advantages in someembodiments, the following provides a use case scenario from theperspective of the guest.

A future guest to a hotel first needs to book their travel plans withthe airlines and a hotel. They do this by either using the hotel/airlinewebsites and/or app or, as in increasingly likely, an OTA. Once this isdone they receive their itinerary. However, now these sites loseconnection with the guest. The Travel Assistants take over. The guesteither sends their information or this process is automatic to theTravel Assistant. Now a site like Google Trips has the travelinformation for a future guest of the hotel. The Travel Assistant takesthat guest to the airport via a cab. Then on to their flight and theneven helps them with arranging their transportation to the hotel at thedestination.

As shown in FIG. 6, by integrating data gate 200 with Google and otherpersonal assistants 608, the hotel now also knows the guest's travelitinerary. The hotel knows when the guest is on their way to the hoteland more importantly, when they will arrive. Because the data gate 200is integrated with these services 604, 606, 608 in the cloud, the hotelnow knows when that guest is due to arrive. From any delays in theirflights to getting up to the minute updates on when exactly that guestwill arrive via local ground transport.

Because data gate 200 is also integrated with the hotel's PMS 206, thePMS 206 can automatically notify staff about when this guest isarriving. With the hotel's guest loyalty systems 602 integrated withdata gate 200 the hotel will know if this is a premier loyalty member.Now the PMS 206 can notify the front door staff at the hotel so thatthey can greet that guest, by name, as they open the door to the cab andhelp the guest into the hotel. “Mr. Levy, welcome!” Starting a verypersonalized service offering. For VIP guests, the hotel system mayissue an alert or other message to the mobile phone or portable deviceof a door staff at the hotel front door with the license plate or otherdescription of the vehicle that will be bringing the guest to the hotel.Optical scanners may be installed at the hotel driveway and detect thevehicle upon arrival to the hotel property and update the notificationsto hotel staff.

Another scenario is once the hotel knows that the guest has landed, thehotel guest services system 602 can send the guest a notification toallow them to remotely check into the hotel. A digital key could be sentto their phone and the guest can proceed right into the hotel and totheir room avoiding any frustrating lines at the front lobby. The guestmay also interact with the hotel and even their assigned guest roombefore they arrive at the hotel. For instance, the guest may send one ormore commands to set up the video system 210 to record a sporting eventso they can watch it when they arrive. Or perhaps order a larger channelpackage so it's ready when they arrive. If all guests of the hotel bydefault get access to ten channels, a guest en route to the hotel maysend a command from the hotel app on their phone or via a reservationpreference etc. to upgrade their room to get the all sports channelpackage.

Now in the hotel and within the hotel's sphere of influence to offerservices to the guest, the data gate 200 can make the personalizedexperience even better. Of course, now that the guest is in the hotelall, their devices automatically authenticate onto the hotel networkwith central authentication 600. Further, the video system 210 in theroom can also adapt to the guest's preferences because that system 210can get the needed information from the hotel's loyalty system 602through data gate 200. The video system 210 sets their preferredlanguage and reorders the channels and content available on theinteractive program guide (IPG) to the guest's preferred line-up andorderings. The room control 212 likewise retrieves the guest'spreferences from the hotel guest loyalty system 602 and sets thetemperature of the room to the guest's liking before they even get tothe hotel. The room control system 212 automatically initiates thetemperature change in response to ground transport messages and/orflight arrival messages received from the ground and flight systems 606,604 such that the room has enough time to cool off (or heat up) beforethe guest arrives. However, because the temperature change is initiatedon actual arrival time of the guest, energy usage is conserved at thehotel by avoiding setting the temperature too early in advance.

There is also integration with room service and other amenities withinthe hotel property. These can be done either through the TV, phone, orhotel mobile app based on information received via the data gate 200. Atthe end of their stay, a bellhop can be requested who can help with theguest's bags. All while a cab has already been called waiting for theirdeparture. All of this can be accessible through the hotel's own brandedapp making the app the one place the guest goes to do anything they needto get done at the hotel.

With all of these services integrated and the flow of data being handledby the data gate 200 the above use case scenario is possible. Thedifferent services do not need to know about all other servicesconnected to the data gate 200. They are just looking for the specificdata and request it from the data gate 200. The data gate 200 handlesthe process from there and ensures the correct data is translated andflows to where it is needed. Without a system like the data gate 200, tostill achieve the above use case scenario would require a mess ofinterconnections similar to as shown in FIG. 1 but with even moreindependent connections between even more service systems. Every servicesystem and the related connections therefrom represent an interface typethat could change, and any change at one system would require changes tobe made at all the other interconnected services connected thereto forcontinued compatibility. Imagine doing this on the scale that is shownin FIG. 6 and one can truly see the advantage of the data gate 200architecture and easy interface configuration process disclosed herein.

Of course, other variations are also possible. For instance, a hotel maynot like the nagging issue that they do not truly get access to theirguest until after the guest arrives at the property. Having a personaltravel assistant system 608 separate from the hotel's guest services 602essentially results in two distinct app's the guest needs to use.Ultimately, they and the hotels may not want this. With a system likedata gate 200 illustrated in FIG. 6, the hotel is given the opportunityto take control of it all.

FIG. 7 shows a trip flow where all data needed by the guest during theirtrip is integrated with a single app running on the user's mobile phone700 via data gate 200. Because the property is integrated with the datagate 200, the hotel can take this to the ultimate step shown in FIG. 7.Instead of losing the guest after they have done their bookings and theexternal travel assistants 608 take over, why not retain the guest andkeep that data within the hotel app? The hotel app can be integratedwith data gate 602 as well. Request and send what the app needs onbehalf of the loyalty guest. For instance, instead of sending theiritineraries to one of the external travel assistants 608, have theitineraries and other bookings sent to the hotel's loyalty branded appinstead.

In this way, a hotel will have truly taken back their guest and giventhem a service they will use from the beginning. They will want to be aloyalty guest even more to gain this functionality. One place to get alltheir information and the same app to do everything they need in thehotel.

All of this is possible if the data is available and integrated. At itscore, the data gate 200 is an integration platform with easy interfacelearning capabilities. Allowing multiple data sources and systems totalk to each other without having to re-invent the wheel each time. Witha system like the data gate 200 in place, a hotel or other establishmentor vendor can regain ownership of their guests. The establishment willown the interaction with the guest all the way from booking 702, totheir travel 704, 706, 708, to their stay at the establishment 710, 712,714, 716, 718, and getting them home again. For the entire journey, thehospitality establishment will have greater potential to retain andcreate new loyal guests.

FIG. 8 shows a block diagram of a system for allowing a guest of ahospitality establishment 800 to utilize their voice to control oneaspects of a guest room 830 according to an exemplary embodiment. In thefollowing description, it will be assumed that the hospitalityestablishment 800 is a hotel, but it is to be understood that the samesystem may also be utilized at other types of hospitality establishmentsother than hotels.

As illustrated, the system includes a guest device 802 such as a mobilephone or laptop computer coupled to a guest local area network (LAN)804. The guest device 802 may be brought to the hotel 800 by the user.The guest LAN 804 is coupled to a gateway 806, and the gateway 806provides access control between a property management system (PMS) 808,a database storage device 810, a hotel app server 812, an in-room deviceLAN 814, and the Internet 836. The PMS 808 stores, among other data,room bookings 832 that specify which guest is assigned to which room inthe hotel. The database storage device 810 stores, among other data, aroom-to-device table 834 that specifies the network addresses and otherinformation about a plurality of in-room devices 816, 818, 820, 822,824, 826 located in each of the guest rooms 830. For instance, in thisexample, a particular guest room 830 is shown to include a TV 816, aset-top box (STB) 818, a room controller 820, one or more controllablelights 822, an air conditioner 824, and a heater 826. Different in-roomdevices may be included in different guest rooms 830 and it is assumedthat the hotel has a plurality of separate guest rooms 830 even thoughonly a single guest room 830 is illustrated in FIG. 8 for simplificationof description. A voice-to-text server 838 is located external to thehotel 800 and coupled to the Internet 836 in this configuration.

Whenever possible, guests would likely prefer to use their ownelectronic device such as portable guest device 802 brought to the hotel800 rather than one provided or otherwise loaned to them by the hotel800. Especially when utilizing devices 802 that have built in recordingfeatures that could potentially eavesdrop, a typical guest would likelyprefer to utilize a device 802 they own and can trust. A recordingdevice 802 that is not personal to the user might get confused whentrying to listen and decode speech from a plurality of different guestswith different accents and voice sounds. A guest device 802 owned by auser will have much better familiarity with the user's voice andtherefore have better reliability and accuracy at understanding theuser's speech.

In view of these preferences, one embodiment of voice control involvesallowing the guest to speak to their own device 802 to control thein-room systems 816, 818, 820, 822, 824, 826. In some embodiments, thevoice control system can leverage the release of iOS 10 and SiriKit forthe iPhone™ and similar implementations coming out from both Google onAndroid™ and Microsoft with Cortana™ on Window's phones. A typical guestwill be completely comfortable having their own device 802 in theirhotel room 830. Likewise, talking to their own device 802 is a featurethat many users already do daily. It is for this reason that theindividual's own device 802 knows how the user speaks. The more aparticular user talks with their device 802, the more the device 802 andassociated voice-to-text services 838 learn that individual user'sspeech sound and patterns. The user's own device 802 is much better atproviding accurate voice recognition than any non-calibrated system thatis bound to give the user all kinds of grief.

In this embodiment, the system leverages existing pairing technologythat hotels have today that allows a guest to pair their device 802 totheir hotel room 830. For instance, the pairing can be done as soon asthe guest device 802 authenticates with the HSIA system 204 in order togain access to the Internet 836. The authentication process may involveroom detection and/or PMS 808 authentication and/or centralauthentication 600.

More details of user authentication and pairing examples according todifferent embodiments are provided in the following patent documents:U.S. Pat. No. 9,137,281 issued Sep. 15, 2015 and entitled “DYNAMICALLYENABLING GUEST DEVICE SUPPORTING NETWORK-BASED MEDIA SHARING PROTOCOL TOSHARE MEDIA CONTENT OVER LOCAL AREA COMPUTER NETWORK OF LODGINGESTABLISHMENT WITH SUBSET OF IN-ROOM MEDIA DEVICES CONNECTED THERETO”,U.S. Pat. No. 9,060,197 issued Jun. 16, 2015 and entitled “HOSPITALITYMEDIA SYSTEM OPERATED BY MOBILE DEVICE”, U.S. Pat. No. 9,369,748 issuedJun. 14, 2016 and entitled “INTEGRATING CONTENT ON REMOTE DEVICEACCESSIBLE VIA INTERNET WITH HOSPITALITY MEDIA SYSTEM”, U.S. Pat. No.8,732,753 issued May 20, 2014 and entitled “METHOD OF OPERATING ONE ORMORE CONTROLLABLE DEVICES IN DEPENDENCE UPON COMMANDS RECEIVED FROM APLURALITY OF MOBILE DEVICES AND SYSTEM CONTROLLER THEREOF”, U.S. Pat.No. 9,462,000 issued Oct. 4, 2016 and entitled “OFF-SITE USER ACCESSCONTROL”, US Published Patent Application No. 20150373123 published Dec.24, 2015 and entitled “CODELESS DEVICE PAIRING BETWEEN MOBILE DEVICE ANDPARTICULAR ONE OF A PLURALITY OF MEDIA DEVICES”, and U.S. Pat. No.9,009,259 issued Apr. 14, 2015 and entitled “AUTOMATIC CLIENT DEVICELOCATION DETECTION WITHIN HOSPITALITY ESTABLISHMENT”. Each of thesepatent and application documents are incorporated herein by reference.As user authentication and pairing (i.e., associating) the user's device802 to a particular room 830 are already well-known in the art, furtherdescription of the authentication and pairing process is omitted hereinfor brevity.

After the guest device 802 is authenticated and paired with a room 830,the guest-device-to-room table 835 will be updated to store a mapping ofwhich room 830 is associated with the guest device 802. The user of theguest device 802 can then use Siri on their Apple device (or anothervoice command system such as Cortana on Microsoft, Alexa on Amazon,Google Assistant on Google, etc.) to turn on the lights 822 or operateany of the other in-room controllable devices 816, 818, 820, 822, 824,826 of their assigned guest room 830.

Taking Apple's Siri as an example, the user may simply by holding downthe home button and say a command such as “turn on the lights”. Thesystem of FIG. 8 then allows that phrase to be tied to the hotel room830 and the user may interact with the technology in the room 830. Insome applications, the guest may leave their phone on the bed or a tablesomewhere and can use the “Hey Siri” function on their Apple guestdevice 802. In this way, the user does not even have to press or holdanything on the guest device 802. This is beneficial for example if theguest is lying in bed and their phone is plugged into the wall chargingwhile being placed on a table. The guest may be feeling sleepy and beready to shut down everything in the room 830 for the night. Instead ofhaving to roll over and turn off everything with a remote or even grabtheir phone 802, the guest may simple say, “Hey Siri, good night.” Thesystem of FIG. 8 takes this command, associates it with the guest's room830, and shuts down the various in-room devices such as a lamp 822 andTV 816 and/or any other in-room devices 816, 818, 820, 822, 824, 826.

The command “good night” in the above example corresponds to a shutdownscript processed by the hotel app server 812 and may be more complicatedthan simply shutting off all the in-room devices 816, 818, 820, 822,824, 826. For instance, a particular user may prefer to only dim acertain light 822 in order to have a night light. Another user mayprefer to have background music playing on TV 816 at night for a certaintime period (or even all night). Likewise, temperature using AC 824and/or heater 826 may be set to preferred setting for sleeping. Thesystem may have any number of voice commands that act as macros orscripts to perform a number of functions in the room in response toreceiving a voice command. Variables in the commands may be adjusted ona user specific basis such as to set a particular user's preferredtemperature etc.

In some embodiments, the voice control system enables a full “No-Touch”room where the user can control everything in the guest room 830 withoutneeding to touch anything in the room 830. The ability to arrive intothe hotel room 830 and simply say, “Hey Siri, turn on the lights.” Nowthe user is in the room 830 and can see what they are doing with thelights on. The next thing a typical user wants to do is turn the TV 816on. This can be done by the user saying, “Hey Siri, Turn on the TV.” Ifthe user finds it a bit warm in the room 830, the user may cool it offby saying, “Hey Siri, set the temperature to 70°.” Now that the room isset up the way the user likes it, the user may get even moresophisticated in voice commands. This is where tight integration withthe technology on the property really starts to shine. For instance, theuser may check the news by saying, “Hey Siri, put CNN on the TV.” Inanother example, the user may watch their favourite TV show. The usermay not themselves know what channel its on and honestly, the user maynot want to go searching through a program guide. No problem, thetechnology will do the work for the user. The user just needs to say,“Hey Siri, put Game of Thrones on the TV.” The hotel app server 812checks the interactive program guide (IPG) for the user's room's TV 816and changes to the appropriate channel that is currently playing “Gameof Thrones.”

Especially for international customers, a benefit of the system of FIG.8 is that the guest may watch desired programming such as sports eventswithout knowing the local channel line up. When a guest is in a foreignland, the guest typically has no idea what channels are used for thesports channels. Just like before, the guest can let the system of FIG.8 find the channel itself given a suitable voice command from the user.With technology like Siri and other voice assistants, the system candetermine what the user means when they say their favourite sports teamor other phrases that might be more confusing or ambiguous if it werereceived from another user. For instance, working with a tightlyintegrated system in the hotel 800, a user from the city of Calgary,Alberta, Canada may be able to simply say, “put the flames game on.”This would be translated to the Calgary Flames hockey team as the targetprogramming because the guest device 802 and/or the voice-to-text server838 and/or the hotel app servers 812 already knows this user's locationand preferences including local sports teams.

The gateway 806 may be integrated with or a part of the data gate 200described earlier in this document for even better functionality. Thisallows any desired interactions between different systems such asallowing the guest device 802 to interact with any connected system ofFIG. 6 for example without needing to reprogram the various interfacesof a first system if one of the other vendors changes its interface typeor format. For instance, the hotel app server 812 may also be coupled tothe data gate 200 thereby allowing the user to use voice commands toretrieve information and otherwise interact with any of the servescoupled to the data gate 200. Not only would the system of FIG. 8 find aTV channel that has hockey on it but it would find the right game withthe Calgary Flames team knowing who the user is and what theirpreference is even as the user travels all around the word. This mayeven include sending video on demand from a video on demand (VOD) server210 coupled to the data gate 200 thereby allowing the user to watch the“flames game” (or any desired content) at a hotel anywhere in the worldeven if the hotel would not otherwise provide that content to otherguests.

These are just a few of the examples of what this technology can do inthe guest room 830. No longer do people have to fiddle with remotecontrols or foreign input devices. They no longer need to scan or searchthrough countless channels to find what they want. Adding voice controlthat they are familiar with drastically streamlines all theseactivities. A guest may be up and running in their room 830 withinseconds.

At the end of the night, the guest just needs to say, “Hey Siri, Goodnight.” The TV 816 shuts off, the thermostat (and/or AC/heater 824, 826)is set to the guest's preferred sleeping temperature, the “do notdisturb” is set, and the lights gently dim off. When that person thenwakes up they may say, “Good Morning”, and the lights 822 turn on andthe TV 816 turns on to their favourite TV station. Embodiments such asFIG. 8 enable the guest to do all this without having to touch anythingthat is not already the guest's and doing it all from the user's owndevice 802 that they trust. The result is like having two-hundreddifferent houses in one place that a user's phone or other device 802could interact with and the user has no need to set up or otherwisemanually link their guest device 802 to any of the in-room devices 816,818, 820, 822, 824, 826 within each of the guest rooms 830 as the usertravels to different locations. The system of FIG. 8 automaticallydetects that the user is located at the hotel 800 from centralauthentication 600 or even global position system (GPS) coordinates onthe user's device 802 or other means. The system automatically detectsthat the user is associated with a particular guest room 830 from thePMS's 808 room bookings 832, and then looks up the various in-roomdevices that are associated with that room 830 from the room-to-devicetable 834.

Any desired voice command scripts such may be user customized orprovided to all users as desired. For example, a “Hey Siri, Movie time”command may dim the lights 822, close the blinds, and turn the TV on tothe pay-per-view movie selection channel. Users may be enabled to recordsequences of commands and store them as a macro and/or tag sequences ofcommands to any voice command. These may be stored within the user'sguest preferences in the hotel guest services 602 account such as withina loyalty program user profile for the guest. The guest may then accessthese macros at any hotel 800 as they travel to different places duringvacation or business or even at home.

FIG. 9 shows a flowchart of a method of controlling a guest room 830using voice commands according to an exemplary embodiment. The steps ofFIG. 9 may be performed by the processors of the user's guest device802, the data gate 200, and the hotel app server 812 for instance, andmay be in conjunction with optional input from the user in the form ofvoice or other UI commands or other processes of computer devices in thesystem. The steps of the flowchart are not restricted to the exact ordershown, and, in other configurations, shown steps may be omitted or otherintermediate steps added.

At step 900, the process beings upon the guest device 802 starting avoice capture process. For instance, this may be done by the guestdevice 802 detecting a predetermined voice capture trigger phrase such a“Hey Siri” for an Apple device. Alternatively, this may occur inresponse to the user pressing a particular button or otherwise manuallyactivating a voice capture function on the guest device 802. The userdevice captures the voice audio from a microphone of the guest device802 and stores a resulting audio file within a memory of the guestdevice 802.

At step 902, the guest device 802 sends the audio file to a cloud-basedvoice-to-text server 838. This step may correspond to the default actionof a factory-included voice command processor built in to the guestdevice 802. For instance, Sin on an Apple device will automatically sendcaptured audio files to an Apple-provided voice-to-text server 838.

At step 904, the voice-to-text server 838 converts the received audiofile into corresponding text. The voice-to-text server 838 may haveseparate parameters and decoding options associated with each user. Inthis way, the guest device 802 will appear to get better and better atrecognizing and decoding a particular user's voice the more that userutilizes the voice capture functionality. After conversion to text, thevoice-to-text server 838 sends the text transcript down to the guestdevice 802 from which the corresponding audio file was originallyreceived.

At step 906, the guest device 802 receives the text transcript from thevoice-to-text server 838.

At step 908, the guest device 802 determines whether the text should bepassed to a hotel app on the guest device 802 and/or elsewhere on thenetwork. In some embodiments, the voice command text is only passed tothe hotel app when the user is currently checked into a compatible hotel800. For instance, upon check-in to guest room 830, the PMS 808 may senda message to the user's guest device 802 informing a hotel app runningon the guest device 802 that the user is now checked in to the hotel800. The hotel app running on the guest device 802 then registers itselfwith Siri as a voice controlled app to which future voice command texttranscripts should be passed. Thereafter, Siri will automatically passreceived text transcripts to the hotel app on the guest device 802.After the guest checks out of guest room 830, the PMS 808 may send amessage to the hotel app running on the guest device 802 that the userhas now checked out. The hotel app then dynamically unregisters itselffrom Siri so that future text transcripts are not passed to the hotelapp. A similar process may also be performed on non-Apple devices. Ingeneral, a hotel app running on the guest device 802 simply registersitself to receive text transcripts of voice commands in response toreceiving a first message or other notification that the user haschecked in to a compatible hotel 800, and then unregisters itself toreceive text transcripts in response to receiving a second message orother notification that the user has checked out of the hotel 800.Again, messages sent to/from the guest device 802 from the PMS 808(and/or other systems) may be passed via data gate 200 to ensure easyintegration between different systems regardless of interface types orchanges of formatting of other systems over time.

In some embodiments, the decision of whether to pass the text record tothe hotel app at step 908 can be based upon an authentication result ofthe hotel app and/or another service at the hospitality establishment800. For instance, after the user of the guest device 802 successfullyauthenticates for Internet access at the HSIA controller 204, the HSIAcontroller 204 may send or otherwise trigger a first message being sentto the hotel app running on the guest device 802 to register itself forreceiving voice command text records. Upon the user's Internet accessexpiring, the HSIA controller 204 may then send or otherwise trigger asecond message being sent to the hotel app running on the guest device802 to deregister itself for receiving voice command text records. Inthis way, the result of step 908 will be “yes” whenever the guest device802 is authorized to access the Internet 836 from the hotel's guest LAN804. A similar process can also be utilized to enable passing voicecommand text records to the hotel app at step 908 whenever the user islogged in to any service at the hotel 800. For example, if the userpurchases bandwidth to stream Netflix to their in-room TV 816, for theperiod of time that this service is enabled, the answer to step 908 maybe “yes”.

Likewise, the hotel app on the guest device 802 may monitor to whatcomputer network it is connected and then register itself and/orderegister itself to receive text records in response to determining theguest device is connected to the computer network of a compatible hotel800. For instance, the guest device 802 in FIG. 8 may automaticallydetect that it is connected to a known hotel's guest LAN 804 andtherefore register the hotel app to receive text transcripts of voicecom-mands. Once the guest device 802 disconnects from the guest LAN 804,the hotel app is automatically deregistered so it won't receive textrecords. Detecting whether the guest device 802 is connected to aparticular computer network may be performed in some embodiments byproviding one or more services only on the LANs of compatible computernetworks. For example, the hotel app may query the connected LAN using aprotocol such as the multicast Domain Name System (mDNS) protocollooking for a specific service only found on compatible hotel LANs.

Other ways of configuring the guest device 802 to pass text records tothe hotel app may also be performed according to different embodiments.For instance, the hotel app running on the guest device 802 can registerand unregister itself to receive text transcripts in response to thecurrent GPS location of the guest device 802 corresponding with theknown location of a compatible hotel. The hotel app on the guest device802 may include a plurality of coordinates of compatible hotels and willtrigger the registration upon the location of the guest device 802moving within a threshold proximity of a compatible hotel. This may bebeneficial for compatibility with establishments that do not requireguests to check in/out, for example.

In yet other examples, the voice command and/or its corresponding texttranscript may be utilized at step 908 to determine whether to forwardthe text to the hotel app. For instance, if the voice command includesthe name of the hotel app, then the text record will be passed to thehotel app. Examples of this include voice commands and correspondingtranscripts such as, “Hey Siri, use the Hotel App to turn on the lights”and “Hey Siri, turn on the lights using the Hotel App.”. Of course, theterm “Hotel App” in the above examples could be changed to anybrand-specific or other predetermined phrase in actual deployments.

In yet other configurations, Bluetooth detection of a controllablein-room device 816, RFID detection of the proximity to a room 830 or anin-room device 822, or direct WiFi to an in-room device 818 may beutilized for automatic registration or enabling passing text transcriptsto the hotel app at step 908.

Any combination and permutation of the above examples and embodimentsmay be utilized to decide at step 908 whether to enable a guest device's802 room control functionality for the hotel room 830.

At step 910, the text transcript is simply processed by the guest device802 in the normal manner as it would be without the involvement of thehotel app. For instance, Siri may already be preconfigured to work withlights or other controllable devices in the user's home. Step 910 justacts as the regular process, i.e., the default action(s) of voicecommands by the guest device 802. In this way, when the hotel roomcontrol functionality is enabled (i.e., “yes” branch of step 908), theuser's voice commands captured by the guest device 802 will operate thelights 822 and other in-room devices 816, 818, 820, 822, 824, 826 in theguest's assigned hotel room 830; however, when the hotel room controlfunctionality is not enabled (i.e., “no” branch of step 908), the user'svoice commands captured by the guest device 802 will operate otherpreconfigured lights and controllable devices outside of the hotel 800such as those installed in the user's home or office.

At step 912, the guest device 802 passes the text transcript to thehotel app. Assuming the hotel app is running on the guest device 802,this may involve Siri or another voice assistant running on the guestdevice 802 internally passing the text record via any predeterminedapplication programming interface (API). For instance, Siri or anothervoice assistant may be preconfigured to pass text from voice commands toany number of registered apps on the guest device 802. In someembodiments, the hotel app or a portion of the app may be running onanother device such as on the hotel app server 812 and this stepinvolves the guest device 802 sending the text record to the otherdevice (e.g., hotel app server 812) via the guest LAN 804 and/or theInternet 836.

At step 914, the hotel app (running on either the guest device 802and/or another device such as the hotel app server 812) sends a messagewith a command corresponding to the text transcript along with userinformation to the room controller 820. For example, assuming the textrecords corresponds to the voice command “turn on the TV”, the hotel appwill send a command corresponding to turning on the TV along with a useridentifier associated with the guest device 802 from which the voicecommand text transcript was received.

At step 916, the room controller 820 checks the room bookings 832 toconfirm that the identified user is indeed currently registered in aparticular guest room 830 of the hotel 800. For example, this may bedone by the room controller 820 searching the room bookings 832 to finda room identifier currently associated with the user identifier receivedat step 914. Assuming a valid room 830 is found, control proceeds tostep 920; otherwise, if no room is found, control proceeds to step 918.

At step 918, because no valid room is found, the room controller 820sends back an error message to the hotel app and/or to an associationprocess/server or other control server. The error message may specifythe problem and require the user of the guest device 802 or otherservers in the system to take specific action to fix the problem such asre-authenticating, rechecking in to the room 830, re-pairing the guestdevice 802 with a particular room 830, attempting an auto-authenticationor auto-pairing process, and/or purchasing more HSIA Internet accesstime, for example.

At step 920, the room controller 820 checks the room-to-device table 834in order to determine the specific network address(es) of one or moretarget in-room controllable devices that are required to complete theaction specified by the voice command text transcript received by theroom controller at step 914. For instance, assuming the guest's room 830is “room 101” and the command is “turn on the TV”, the room controller820 may search the room-to-device table to find the Internet Protocol(IP) address of the TV 816 in “room 101”. For more complicated commandssuch as “good night”, the room controller 820 may need to find the IPaddresses of a plurality of in-room devices 816, 818, 820, 822, 824, 826of “room 101” in order to send all the network messages required toperform the script that corresponds to the voice command. Examplesinclude turning off the TV 816 and STB 816, turning off the lights 822,and setting the thermostat to a desired temperature.

At step 922, the room controller 820 sends one or more network messagesto the IP addresses found at step 920 in order to cause each of thetarget in-room controllable devices 816, 818, 820, 822, 824, 826 of thetarget room to perform the actions required to carry out the voicecommand. This step may involve the room controller 820 sending IPdatagrams and/or opening TCP connections with the various devices andsending commands. It may also involve the room controller 820 operatinga web-based interface of the target controllable device. As the actionsrequired for a room controller 820 to effect commands and control one ormore target controllable devices are well-known in the art, furtherdetails of this step are omitted herein for brevity.

According to some embodiments of the invention, a universal data gate200 converts between interface format types of interconnected systems.The data gate 200 learns new interface types and greatly simplifies therequirement for a human user to reprogram the new interface types. Alibrary of known interface types is built up over time and allows re-useof known interface types as required.

According to some embodiments of the invention, voice based room controlis enabled by automatically activating the voice control on a guestdevice 802 when the guest is checked in to a hotel room 830. Textcorresponding to voice commands captured from the user's voice is passedto a hotel app. The system automatically pairs the guest device 802 withthe user's assigned room 830 and determines which in-room controllabledevices are to be operated by the user's voice commands. When the userswitches to a new guest room during travel, the system automaticallyupdates the room pairing and new voice commands operate the new in-roomdevices.

Although the invention has been described in connection with preferredembodiments, it should be understood that various modifications,additions and alterations may be made to the invention by one skilled inthe art without departing from the spirit and scope of the invention.For example, although the above-description has focused on a hotel forillustration purposes, the present invention is equally applicable toany hospitality related location or service including but not limited tohotels, motels, resorts, hospitals, apartment/townhouse complexes,restaurants, retirement centers, cruise ships, busses, airlines,airports, shopping centers, passenger trains, libraries, coffee shops,hotspots, etc. Additionally, in addition to the above describedhospitality examples, the invention is applicable outside thehospitality industry such as at a home or corporate environment.

Although the above flowchart of FIG.9 and related description wasdescribed in conjunction with a hotel app running on the guest device802, it is not a requirement that the guest device 802 must run a hotelspecific application to perform the receipt of text records at step 906.In other embodiments, the functionality described herein as beingperformed by the hotel app could instead be built in to the operatingsystem or be included in another application running on the guest device802 such as the Siri application or other voice assistants. Likewise,the hotel app equivalent functionality is not limited to be beingperformed on only the guest device 802. For instance, the decision ofstep 908 could be moved from the guest device 802 to any other networklocation such as being performed by the cloud-based voice-to-text server838. Likewise, other steps of FIG. 9 may be moved to be performed on acomputer server such as the hotel app server 812, for example.

In another example of a modification of FIG. 9, in some embodiments, thetext transcript of voice commands received at step 906 are always passedto hotel app, i.e., the output of step 906 proceeds directly to step912. However, the hotel app only utilizes the text command if one of theconditions described above for step 908 is true. In other words, thedecision of “pass to hotel app?” step 908 is moved to after step 912 andis renamed something like, “hotel app active?” If the hotel app isactive such as because the user is currently checked in to the hotel,then the flowchart will proceed to step 914; otherwise, the hotel appcan just send the text record to the default app (i.e., default actionstep 910).

In another example, text transcripts are always passed to the hotel appserver 812 whenever the hotel app server 812 is detected on any networkaccessible to the guest device 802. The hotel app server 812 operates asa proxy behind the scenes, possibly in conjunction with the PMS 808and/or other services at the hotel 800, in order to figure out whichcontrollable devices are authorized for use by the guest device 802 (ifany) and to operate those authorized controllable devices in dependenceupon the user's voice commands.

In this disclosure, the term “guest device” is intended to mean any userdevice operated by a guest of the hospitality establishment 800.Although it is beneficial for many of the reasons described herein thatthe guest device 802 be owned by the user, this is not a strictrequirement and the same technology could also be applied when the guestdevice 802 is owned or otherwise provided by the hotel. For instance,because the guest device 802 does not need to be programmed in advanceto work with any specific in-room devices 816, 818, 820, 822, 824, 826,the design of FIG. 8 and FIG. 9 beneficially allows the guest device 802to be moved from room to room 830 within the establishment 800 and thesystem will always make sure the correct room's in-room devices 816,818, 820, 822, 824, 826 are controlled. In other words, it is notrequired that the user preprogram their guest device 802 with the IPaddresses or other configuration details of the specific in-room devices816, 818, 820, 822, 824, 826. Instead, the system will just work andensure that the voice commands control the appropriate in-room devicesspecific the guest's assigned hotel room 830. If the guest changes rooms830 (or hotels 800), further voice commands will now control the newin-room devices. This configuration free operation of guest device 802is beneficial for individual users because their own devices such asmobile phones and computers do not need to be preprogrammed with thenetwork addresses of their room's 830 various in-room controllabledevices 816, 818, 820, 822, 824, 826. The same benefit also applies tohotel owned guest devices 802 such as a hotel-provided in-room iPad orother device. Deployment and maintenance is greatly simplified as theguest devices 802 may easily be moved from room to room at any timewithout requiring a complicated setup procedure to be performed by thehotel 800 each time the guest device 802 switches rooms 830. All that isrequired is that the system authenticate the guest device 802 and pairit with a particular room 830. If the guest device 802 is provided bythe hotel 800, the authentication and pairing may be as simple as hotelstaff entering a hidden configuration menu on the guest device 802 inorder to enter a room number or other room identifier. From that pointon, the system will recognize the guest device 802 as being paired withthe new room.

In yet another example of a modification, the voice-to-text conversionof step 904 could also be done locally by a voice-to-text serviceprovided within the guest device 802 or by a server on premise at thehospitality establishment 800. This may be beneficial in someapplications for increased user privacy or when there is no connectionavailable to the Internet 836.

Again, any of the above-described devices may be integrated with oneanother via the data gate 200, and it is to be understood that each ofthe above-described devices includes one or more processors coupled to astorage medium holding processor executable instructions. For instance,by one or more processors of the guest device 802 executing softwareinstructions of the hotel app, the guest device 802 is made operable toperform the above-described operations of the hotel app. Likewise, byone or more processors of the data gate 200 executing softwareinstructions from a coupled storage medium, the one or more processorsare operable to perform the above-described operations of the data gate200.

In yet other embodiments, the functionality of any or all of theabove-described devices may be merged together. For instance, FIG. 10illustrates a computer server 1000 including one or more processors 1002coupled to a first network interface 1004, a second network interface1006, a third network interface 1008, one or more storage devices 1010,and a real-time clock chip 1012. The first network interface 1004 iscoupled to the Internet 836, the second network interface 1006 iscoupled to the guest LAN 804, and the third network interface 1008 iscoupled to the in-room device LAN 814. Especially for the data gate 200functionalities, the server 1000 may also include any number ofdifferent types of communication interfaces in addition to networkinterfaces. Examples of other communication interface include serialinterfaces 1016 that might be utilized by legacy serial devices 1016.Other communications interfaces may be included to support any desiredwired and wireless protocols and interconnection hardware. The one ormore storage devices may be implemented as a combination of harddrive(s) and random access memory, for example, and store therein anumber of software modules and associated data. Specifically, thestorage device(s) 1010 in this embodiment include software modulesproviding functions of the data gate 200, the HSIA controller 204, thenetwork gateway 806, the room controller 820, the room-to-device table834, and the hotel app server 812. The clock chip 1012 may be utilizedto measure time such as to calculate and/or monitor expiry times for theroom control functionality and/or other services provided by the server1000.

Other software modules and data 1014 may be included as desired. Forinstance, in another embodiment, the data gate 200, gateway 806, PMS808, database storage device 834, hotel app server 812 and roomcontroller 820 may all be implemented on a single computer server 1000in some embodiments, and the computer server 1000 located in an onpremise location such a server room of the hotel 800, for example.

The above-described devices, modules, flowcharts, and otherfunctionality may be implemented by software executed by one or moreprocessors operating pursuant to instructions stored on a tangiblecomputer-readable medium such as a storage device to perform theabove-described functions of any or all aspects of the accesscontroller. Examples of the tangible computer-readable medium includeoptical media (e.g., CD-ROM, DVD discs), magnetic media (e.g., harddrives, diskettes), and other electronically readable media such asflash storage devices and memory devices (e.g., RAM, ROM). Thecomputer-readable medium may be local to the computer executing theinstructions, or may be remote to this computer such as when coupled tothe computer via a computer network such as the Internet. The processorsmay be included in a general-purpose or specific-purpose computer thatbecomes any of the above-described devices as a result of executing theinstructions.

In other embodiments, rather than being software modules executed by oneor more processors, the above-described devices, modules, flowcharts,and other functionality may be implemented as hardware modulesconfigured to perform the above-described functions. Examples ofhardware modules include combinations of logic gates, integratedcircuits, field programmable gate arrays, and application specificintegrated circuits, and other analog and digital circuit designs.

Unless otherwise specified, features described may be implemented inhardware or software according to different design requirements. Inaddition to a dedicated physical computing device, the word “server” mayalso mean a service daemon on a single computer, virtual computer, orshared physical computer or computers, for example. All combinations andpermutations of the above described features and embodiments may beutilized in conjunction with the invention.

What is claimed is:
 1. A voice-controlled system for allowing a guest of a hospitality establishment to play desired media content on an in-room device, the system comprising: a user device operated by a guest of the hospitality establishment, the user device having a microphone and a network interface; one or more servers coupled to a computer network; and a plurality of in-room devices coupled to the one or more servers; wherein the user device is operable to capture audio from the microphone and convert the audio into a text transcript utilizing a voice-to-text conversion service; the user device is further operable to pass the text transcript to the one or more servers via the computer network; the one or more servers are operable to determine a particular room of the hospitality establishment with which the user device is currently associated; the one or more servers are further operable to check a program guide for the particular room in order to determine a channel on which a program name determined according to the text transcript is currently playing; the one or more servers are further operable determine one or more target in-room devices of the particular room; the one or more servers are further operable to send one or more commands to the one or more target in-room devices of the particular room thereby causing the one or more target in-room devices to play the channel on which the program name is currently playing.
 2. The voice-controlled system of claim 1, wherein the one or more servers are further operable to determine the program name by translating one or more words in the text transcript to the program name according to stored preferences for the guest.
 3. The voice-controlled system of claim 1, wherein the one or more servers are further operable to determine the program name being one or more words in the text transcript.
 4. The voice-controlled system of claim 1, wherein: the user device further includes a storage device storing therein a software application; by one or more processors of the user device executing the software application, the software application is operable to temporarily register itself with a pre-existing voice assistant software running on the user device in response to a first trigger and to deregister itself from the pre-existing voice assistant software in response to a second trigger; and the user device is operable to send the text transcript received from the voice-to-text service to the software application only while the software application is registered with the pre-existing voice assistant software running on the user device, such that other text transcripts received from the voice-to-text service while the software application is not registered with the pre-existing voice assistant software are not sent to the software application.
 5. The voice-controlled system of claim 4, wherein the software application temporarily registers itself with the pre-existing voice assistant software in response to the software application receiving a check-in message from a property management system (PMS) of the hospitality establishment.
 6. The voice-controlled system of claim 4, wherein the software application temporarily registers itself with the pre-existing voice assistant software in response to the user device successfully authenticating itself with a service of the hospitality establishment.
 7. The voice-controlled system of claim 6, wherein the service of the hospitality establishment is a high speed internet access (HSIA) service.
 8. The voice-controlled system of claim 4, wherein the software application temporarily registers itself with the pre-existing voice assistant software in response to detecting a predetermined service on the computer network.
 9. The voice-controlled system of claim 4, wherein the software application temporarily registers itself with the pre-existing voice assistant software in response to a global position system (GPS) chip within the user device indicating a current position of the user device matches a known position of the hospitality establishment.
 10. A control server for allowing a guest of a hospitality establishment to play desired media content on an in-room device, the control server comprising: a network interface for coupling to a computer network of the hospitality establishment; a storage device; and one or more processors coupled to the network interface and the storage device; wherein, by the one or more processors executing software instructions loaded from the storage device, the one or more processors are configured to: receive a text transcript from a user device via the computer network, the user device being operated by the guest of the hospitality establishment; determine a particular room of the hospitality establishment with which the user device is currently associated; check a program guide for the particular room in order to determine a channel on which a program name determined according to the text transcript is currently playing; determine one or more target in-room devices of the particular room; and send one or more commands to the one or more target in-room devices of the particular room thereby causing the one or more target in-room devices to play the channel on which the program name is currently playing.
 11. The control server of claim 10, wherein the one or more processors are further operable to determine the program name by translating one or more words in the text transcript to the program name according to stored preferences for the guest.
 12. The control server of claim 10, wherein the one or more processors are further operable to determine the program name being one or more words in the text transcript.
 13. The control server of claim 10, wherein the one or more processors are further operable to: send a first message to the user device in response to a first trigger, the first message causing a predetermined software application on the user device to temporarily register itself with a pre-existing voice assistant software running on the user device thereby causing the pre-existing voice assistant software to pass one or more voice-to-text transcripts to the predetermined software application; wherein the pre-existing voice assistant software only passes the voice-to-text transcripts to the predetermined software application while the predetermined software application is registered with the pre-existing voice assistant; and receive the text transcript from the predetermined software application running on the user device, the text transcript being passed to the predetermined software application by the pre-existing voice assistant software running on the user device.
 14. The control server of claim 13, wherein the first trigger corresponds to the user device being successfully authenticated for high speed Internet access (HSIA) at the hospitality establishment by an HSIA controller.
 15. The control server of claim 13, wherein the first trigger corresponds to the user device being successfully logged in to a service at the hospitality establishment.
 16. The control server of claim 13, wherein the first trigger corresponds to a user associated with the user device being checked in to the hospitality establishment by a property management system (PMS).
 17. A method of allowing a guest of a hospitality establishment to play desired media content on an in-room device, the method comprising: receiving, by one or more computer servers, a text transcript from a user device via the computer network, the user device being operated by the guest of the hospitality establishment; determining, by the one or more computer servers, a particular room of the hospitality establishment with which the user device is currently associated; checking, by the one or more computer servers, a program guide for the particular room in order to determine a channel on which a program name determined according to the text transcript is currently playing; determining, by the one or more computer servers, one or more target in-room devices of the particular room; and sending one or more commands from the one or more computer servers to the one or more target in-room devices of the particular room thereby causing the one or more target in-room devices to play the channel on which the program name is currently playing.
 18. The method of claim 17, further comprising determining, by the one or more computer servers, the program name by translating one or more words in the text transcript to the program name according to stored preferences for the guest.
 19. The method of claim 17, further comprising determining, by the one or more computer servers, the program name being one or more words in the text transcript.
 20. The method of claim 17, further comprising: capturing audio from a microphone of the user device; converting, by the user device, the audio into the text transcript utilizing a voice-to-text conversion service; temporarily registering a software application running on the user device with a pre-existing voice assistant software running on the user device in response to a first trigger; sending, by the user device, the text transcript received from the voice-to-text service to the software application only while the software application is registered with the pre-existing voice assistant software running on the user device, such that other text transcripts received from the voice-to-text service while the software application is not registered with the pre-existing voice assistant software are not sent to the software application; passing the text transcript from the software application running on the user device to the one or more computer servers via the computer network; and deregistering the software application from the pre-existing voice assistant software in response to a second trigger. 